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ABSTRACT 


Although  it  is  often  the  case  that  the  parameters  of  the  distribution  of 
demand  are  not  known  with  certainty  and  that  a  Bayesian  formulation  would  be 
appropriate,  such  an  approach  is  generally  not  used  in  inventory  calculations 
for  computational  reasons.  Since  one  often  resorts  to  a  non-Bayesian  formula¬ 
tion,  it  is  of  interest  to  compare  Bayesian  policies  with  a  comparable  non- 
Bayesian  policy.  It  was  anticipated  that  the  non-Bayesian  policy  (quantity 
ordered)  would  be  an  upper  bound  to  the  Bayesian  policy.  This  result  is  es¬ 
tablished  for  a  two-period  standard  inventory  model  and  for  the  n-period  non¬ 
depletive  inventory  model.  However,  a  counterexample  is  given  in  the  standard 
inventory  model  for  an  alternative  comparable  non-Bayesian  formulation. 


I .  INTRODUCTION 


The  bulk  of  the  development  of  stochastic  dynamic  optimization  models  has 
been  based  on  the  assumption  that  the  underlying  probability  distribution  func¬ 
tions  are  known  with  certainty.  However,  in  most  real-world  applications  a  cer¬ 
tain  degree  of  uncertainty  exists  about  these  functions.  Being  in  a  dynamic 
situation  provides  additional  information  via  observations  of  the  random  vari¬ 
ables  under  consideration.  Thus,  when  faced  with  such  uncertainty,  it  would  be 
desirable  if  one  can  incorporate  into  the  optimization  model  the  initial  state 
of  knowledge  as  well  as  the  additional  information  as  it  becomes  available. 

A  Bayesian  approach  is  often  appropriate  in  these  cases,  and  dynamic  program¬ 
ming  is  the  standard  solution  technique.  A  Bayesian  dynamic  program  gives  rise 
to  adaptive  policies  which  are  dependent  on  the  past  history.  The  state  space 
is  expanded  to  include  a  new  state  variable  that  represents  past  information. 

In  [17],  Rieder  shows  how  such  an  expansion  of  the  state  space  reduces  the 
Bayesian  dynamic  program  to  one  with  a  completely  known  transition  law.  The  op¬ 
timal  policy  may  then  be  determined  by  solving  the  resulting  optimality  equa¬ 
tions  that  are  in  terms  of  the  augmented  state  variable. 

Among  the  advantages  of  a  Bayesian  approach  are  the  following: 

(1)  The  decision  maker  can  express  his/her  intuition  and  previous  experi¬ 
ence  by  choosing  a  prior  distribution. 

(2)  The  prior  distribution  expresses  the  past  experience  and  prior  beliefs 
in  a  quantifiable  form  which  can  be  formally  included  in  the  optimization  model. 

(3)  Bayes  rule  provides  a  well  defined  procedure  to  revise,  or  update, 
the  prior  beliefs  as  new  information  becomes  available. 

However,  a  Bayesian  approach  is  not  without  disadvantages.  We  let  <j)(t|w) 
represent  the  partially  specified  distribution  with  w  being  the  unknown  para¬ 
meter.  We  also  let  g(w)  denote  the  prior  distribution  of  w.  Bayes  rule  is 
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applied  to  update  g(w).  In  most  optimization  models  the  prior  distribution 
g(w)  is  chosen  from  the  conjugate  family  for  <J>(t|w).  This  choice  is  desirable 
since  it  results  in  an  updated  g(>)  within  the  same  family,  and  hence  simpli¬ 
fies  its  determination.  On  the  other  hand,  the  disadvantage  lies  in  the  fact 
that  representation  of  prior  beliefs  is  restricted  to  a  choice  from  the  con¬ 
jugate  family.  This,  generally,  is  not  a  serious  problem  when  the  conjugate 
family  is  rich;  that  is  when  it  includes  distributions  with  different  location, 
dispersion,  and  shape,  so  as  to  represent  a  wide  variety  of  states  of  prior 
beliefs. 

A  much  more  serious  disadvantage,  however,  is  that  the  Bayesian  dynamic 
program  has  a  multi-dimensional  state  variable,  and  it  is  rarely  cost-effective 
to  compute  optimal  solutions.  In  inventory  applications  this  computational 
intractability  is  typically  "resolved"  by  assuming  that  the  underlying  proba¬ 
bility  distributions  are  known  with  certainty.  This  non-Bayesian  formulation 
can  be  thought  of  as  an  approximation  to  the  Bayesian  inventory  model.  The 
question  this  paper  considers  is  the  relationship  between  the  optimal  policy 
of  the  Bayesian  inventory  model  and  the  non-Bayesian  approximation. 

In  comparing  the  Bayesian  with  the  non-Bayesian  model  a  major  difference 
is  that  further  information  will  be  forthcoming  in  the  Bayesian  case.  There¬ 
fore,  it  appears  that  one  wants  to  avoid  committing  oneself  in  the  Bayesian 
case.  In  the  inventory  model  committing  means  purchasing  inventory,  since  if 
too  little  is  purchased  more  can  be  purchased  in  the  next  period,  while  if 
too  much  is  purchased  there  is  nothing  to  do  but  wait  for  subsequent  demand 
to  lower  inventory  to  a  proper  amount.  Therefore,  the  anticipated  result  is 
that  the  quantity  ordered  for  the  Bayesian  model  is  always  less  than  or  equal 
to  the  non-Bayesian  approximation. 

The  details  of  the  model  are  presented  in  Section  2  and  two  alternatives 


for  the  formulation  of  the  non-Bayesian  approximation  to  the  Bayesian  model  are 
given.  Section  3  is  a  counterexample  which  shows  the  Bayesian  model  ordering 
more,  using  the  first  alternative  formulation  of  the  non-Bayesian  approximation. 
Section  4  establishes  the  expected  result  in  a  two-period  model  using  the  second 
alternative  formulation  of  the  non-Bayesian  approximation.  Section  5  considers 
the  non-depletive  inventory  model  which  differs  from  the  standard  model  in  that 
demand  does  not  reduce  the  inventory  level.  Examples  are  repairable  inventory 
items  and  capacity  expansion  models  where  capacity  plays  the  role  of  inventory. 
For  the  non-depletive  model,  the  expected  result  is  obtained  for  the  n-period 
model  using  the  first  alternatiave  formulation  of  the  non-Bayesian  approxima¬ 
tion. 

Other  work  in  Bayesian  inventory  models  has  been  mainly  concerned  with  de¬ 
riving  the  equations  of  optimality  and  the  characterization  of  the  optimal 
policy.  This  work  includes  Dvoretskey,  Kiefer,  and  Wolfowitz  [8],  Scarf  [19], 
Karlin  [14],  Iglehart  [13],  Hayes  [12],  Fukuda  [11],  Van  Hee  [22],  and  Waldman 
[23].  A  fascinating  computational  result  was  obtained  by  Scarf  [20]  who  showed 
how  the  state  variable  in  the  Bayesian  inventory  model  can  be  reduced  to  one 
state  variable  in  the  case  of  linear  costs,  and  a  gamma  demand  with  a  conjugate 
gamma  prior.  This  result  has  been  obtained  by  Azoury  [2]  for  other  demand  dis¬ 
tributions  for  both  the  standard  and  the  non-depletive  inventory  models. 

II.  The  Model 

We  will  consider  a  finite  horizon  inventory  model  with  N  periods  and  with 
a  linear  ordering,  holding,  and  shortage  costs  described  by  parameters  c,  h,  and 
p  respectively.  Following  Scarf  [19]  we  will  usually  assume  that  the  demand 
T  is  a  continuous  random  variable,  and  that  it  may  be  described  by  a  density 
$(t|w).  For  expository  purposes  we  will  assume  that  this  density  is  from  the 
exponential  class  so  that 

$(t|w)  *  b(w)e  twr(t). 
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We  will  assume  that  set  of  t  such  that  r(t)  >0  is  convex  so  that  the  distribu¬ 
tion  function  of  T  is  strictly  increasing.  Also  we  shall  assume  that  an  a 
priori  distribution  for  w,  g(w)  ,  is  given. 

At  the  beginning  of  the  nth  period,  n  _<  N,  the  information  available 
to  the  decision  maker  is  the  present  stock  level  x,  and  the  previous  demand 

observations  t^,...,tn_^,  which  may  be  summarized  in  the  sufficient  statistic 
n-1 

S  =  53  t.,/n-l.  The  variables  x  and  S  will  be  the  state  variables  of  the 

i=l 

Bayesian  dynamic  program. 


By  Bayes  rule  the  posterior  density  of  w  given  (S,n-1)  is 

,  ,  .n-1.  \  -w(n-l)S  .  . 

g(w|s,n-l)  =  _ (w)e _ g !»)__. 


/ 


bn"1(0)e“6(n"1)Sg(e)d0 


(2) 


Hence  the  probability  density  function  of  t  given  (S,n-1)  is 

OO 

4>(t  |s,n-l)  =  r(t)  f  b(0)e'6tg(0|s,n-l)d0. 

—OO 


(3) 


If  we  introduce  the  notation  <Mt|s)  =  4>(t  I  S,n-1) ,  then  4>n (t  | S)  represents 
the  probability  density  of  demand  that  faces  the  decision  maker  in  period  n  given 
that  S  is  the  mean  of  the  previous  n-1  demands.  Thus  from  (2)  and  (3)  above 
we  get  that 


r(t) J'  bn(0)e"9te  9Cn_1)Sg(0)d0 

Vt|S>  =  - - (4) 

f  bn“1(0)e  9(n"1)Sg(0)d0 


^et  fn{x>s)  denote  the  expected  value  of  discounted  costs  from  period  n  to 
the  end  of  the  horizon,  where  the  inventory  level  before  ordering  is  x,  the  suf¬ 
ficient  statistic  is  S,  and  an  optimal  ordering  policy  is  followed.  The  func¬ 
tional  equation  for  fn(x,S)  is: 


f 

n 


(x,S) 


=  min  / c (y-x)  +  L  (y|s) 
y>x  t  n 

+  &  f  fn+1(y-t,S‘t)<j>n(t|s)dt| 


(5) 
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with  fN+1(x,S)  =  0,  and  L^Cy ( S),  representing  the  expected  one-period  holding 


and  shortage  costs,  given  by 


l  (y|s) 


(J'  h(y-t)<J>n(t  |s)dt  ♦/  p(t-yHn(t  |s)dt  if  y  >  0 
=  <0  y  (6) 


(  f  p(t-y)^n(t  |s)dt 
0 


if  y  <  0 


The  parameter  3  represents  the  one  period  discount  factor.  The  notation  Sot  is 
the  updated  sufficient  statistic  which  equals  {(n-l)S+t}/n  =  S  +  (t-S)/n  for  the 
exponential  case.  It  will  cause  no  difficulty  in  what  follows  to  allow  the  para¬ 
meters  c,  h  and  p  to  vary  with  the  period,  or  to  permit  the  salvage  function, 
fN+l(x,S),  to  be  linear. 

As  indicated  in  the  introduction,  it  is  often  not  cost-effective  to  solve 
(5)  for  the  optimal  policy  and  instead  a  non-Bayesian  formulation  is  solved. 

This  raises  the  question  of  what  the  non-Bayesian  demand  distribution  should  be 
and  we  will  give  two  possibilities. 

For  both  alternatives  of  the  non-Bayesian  models  we  restrict  attention  to 
a  planning  horizon  of  two  periods,  and  we  assume  that  the  demand  random  vari¬ 
ables  are  independently  distributed.  These  variables  will  be  denoted  by  T  and 
T^  with  densities  $^(*)  and  ^(‘). 

The  first  non-Bayesian  formulation  called  Case  I  defines  the  independent 
demand  distributions  to  be  such  that 

^(t)  =  $2(t)  V’  4>(t  |  co)  g  (o>)  da) .  (7) 

—00 


So,  in  each  period,  the  demand  distribution  of  this  non-Bayesian  model  equals 
the  Bayes  estimate  of  the  unknown  demand  distribution  4>(t|w)  with  respect  to 
the  initial  prior.  This  Case  I  non-Bayesian  model,  therefore,  assumes  that  the 
first  estimate  of  the  unknown  distribution  is  the  true  one.  In  period  1  the 
Case  I  non-Bayesian  model  and  the  Bayesian  model  have  identical  demand  distri¬ 
butions. 

The  second  non-Bayesian  model  called  Case  II  is  formulated  as  follows. 
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The  distribution  of  demand  T^  in  period  1  is  given  by  <+>^(t)  as  defined  in 

(7) .  In  period  2,  the  demand  random  variable  T2  is  independent  of  and 
satisfies 

-  Q> 

T1  +  t2  =  Tx  +  I,  (8) 

So,  the  Bayesian  model  and  the  Case  II  non-Bayesian  approximation  have  equal 
distributions  for  both  the  demand  in  period  1  and  the  sum  of  demands  over  the 
two  periods.  The  difference  between  the  two  models  is  that  T^  and  T2  are  de¬ 
pendent,  while  T^  and  T2  are  independent.  The  existence  of  a  random  variable 
T2  satisfying  (8)  is  a  non-trivial  issue.  In  Section  4,  it  will  be  shown  that 

(8)  holds  for  the  normal  random  variable. 

For  either  non-Bayesian  case  let  f^(x)  denote  the  expected  value  of  dis¬ 
counted  cost  from  period  n  to  the  end  of  the  horizon  where  the  inventory  level 
before  ordering  is  x,  and  an  optimal  ordering  policy  is  followed.  The  func¬ 


tional  equation  for  f^Cx)  is : 


f  (x)  =  min  Jc(y-x)  +  L  (y)  +  3  f  f  (y-t)<f>  (O dt  ( 
y >X  (  .  n  n+i  n  ) 


with  fN+1(x)  =  0,  and 


Ln(y)  =  0 


f 

s  h(y-t)<J>n(t)dt  +y  P(t-y)5  (t)dt  if  y  >  0 

0  y  n 

/  p(t-y)<|>  (t)dt  if  y  <  0. 


III.  A  Counterexample 


This  counterexample  to  the  "result"  that  a  Bayesian  inventory  model  will 


never  order  more  than  its  non-Bayesian  approximation  assumes  that  demand  for 
the  non-Bayesian  approximation  is  defined  by  (7)  (Case  I).  We  will  allow  de¬ 
mand  to  assume  three  values  {0,1,2}.  Let  p . ,  i  *  0,  1,  and  2,  represent  the 

2 

probability  of  demand  i,  where  p^,  p^,  and  p2  are  unknown,  and  p  =  1. 

i=0 

The  conjugate  prior  for  p^,  p^  and  p2  is  the  Dirichlet  distribution  which  in  this 
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It  is  known  that  the 


case  is  described  by  three  parameters  Nq,  N^,  and  N2> 

Bayes  estimate  of  the  probability  that  demand  is  i  is  N./E.N..  Let  i  be  the 

i  J  J 

observed  demand.  Then  the  prior  is  updated  by  increasing  to  +  1  and 
leaving  ,  j  4  i»  unchanged. 

In  this  counterexample  it  is  crucial  that  the  distributions  have  very 
small  tails  and  so  we  let  Nq  =  1,  =  97,  and  N2  =  1.  For  the  first  period 

of  the  Bayesian  model  and  for  both  periods  of  the  non-Bayesian  approximation, 
the  Bayes  estimate  of  the  probability  that  demand  equals  0  is  1/99,  that  demand 
equals  1,  is  97/99,  and  that  demand  equals  2  is  1/99. 

For  the  Bayesian  model,  the  following  table  lists  the  probability  distri¬ 
butions  for  demand  in  period  2  for  all  possible  realizations  of  demand  in 
period  1. 

Demand  in  period  2 


Given  0  100  10()  10() 

r .  i  _1_  98  1 

Given  1  100  10()  10Q 

o  1  97  2 

Given  2  100  100  100 

All  costs  are  linear  with  the  following  per  unit  rates.  The  ordering  cost 
c  =  3,  the  holding  cost  h  =  0,  the  penalty  cost  p  =  3.009,  and  a  piecewise  linear 
salvage  function  f^(x)  =  min(0,-1.025x) .  It  was  necessary  to  choose  care¬ 
fully  the  probabilities  and  the  cost  structure.  The  difficulty  encountered  in 
making  the  right  choice  of  numbers  may  be  taken  as  an  indication  that  in  most 
cases  the  Bayesian  critical  number  in  period  1  is  not  larger  than  the  non- 
Bayesian  one. 

Let  n  =  1,2  represent  the  expected  value  of  immediate  costs  plus  the 


minimum  expected  future  costs  where  x  is  the  starting  inventory  in  period  n.  As 
an  example  say  we  start  with  x  =  1  at  the  beginning  of  period  2.  At  the  end  of 
period  2,  our  inventory  level  may  be  either  1  or  0  or  -1.  For  the  non-Bayesian 
model,  J2(l)  =  (-1.025)(l/99)  +  (3.009) (1/99)  =  0.020040404.  For  the  Bayesian 
model,  assuming  demand  in  period  1  was  0,  then  J2(l|0)  =  (-1.025) (2/100)  + 

(3. 009) (1/100)  =  0.00959.  The  following  table  gives  the  values  of  J2(x)  when 
x  =  2,1, 0,-1  for  both  models 

Inventory  Level 


X  = 

2 

1 

0 

-1 

Non-Bayesian 

J2(x) 

-1.025 

0.020040404 

3.009 

6.018 

Bayesian 

J2(x|0) 

-1.03525 

0.00959 

2.97891 

5.98791 

Bayesian 

J2(x|l) 

-1.025 

0.01984 

3.009 

6.018 

Bayesian 

J2(x|2) 

-1.01475 

0.04993 

3.03909 

6.04809 

The  equation  of  optimality  in  period  n  in  the  non-Bayesian  case  is 

£n(x)  =  minjc(y-x)  +  Jn(y)i*  .  (H) 

y>x  *  ' 

The  Bayesian  equation  is 

f  (x|i)  =  minic(y-x)  +  Jn(y|i)l,  (12) 

n  y >x '  n  ' 

Using  the  numbers  given  in  the  table  above,  and  recalling  that  c  =  3,  (11) 
and  (12)  show  that  the  optimal  ordering  level  in  period  2  is  zero  for  both  the 
non-Bayesian  case  and  the  Bayesian  cases. 

In  period  1  there  is  no  demand  history  and  the  Bayesian  as  well  as  the  non- 
Bayesian  model  have  only  one  state  variable.  The  values  of  the  functions 
are: 
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Non-Bayesian 

Bayesian 

Jx(2) 

0.039675951 

0.03968 

JL(1) 

3.039505458 

3.039703838 

Jx(0) 

9.018 

9.018 

For  example  for  the  Bayesian  model 

J^l)  =  (3.009)(l/99)  +  (l/99)f2(l|0)  +  (97 /99>  f  2  (0 1 1)  +  (l/99)f2(-l  1 2) 

=  1/99 [ 3 . 009  +  0.00959  +  (97) (3.009)  +  6.03909] 

=  3.039703838. 


The  equations  of  optimality  (11)  and  (12)  indicate  that  in  period  1  the 
Bayesian  model  with  an  inventory  level  of  0  orders  2  while  the  non-Bayesian 
model  with  an  inventory  level  of  0  orders  1. 

IV.  The  Standard  Inventory  Model 

In  this  section  we  will  consider  the  two-period  model  and  assume  that  the 
demand  distribution  in  period  2  for  the  non-Bayesian  approximation  satisfies  (8) 
(Case  II) .  We  will  show  that  for  the  exponential  class  of  distributions  satisfy¬ 
ing  a  single-crossing  hypothesis,  the  Bayesian  inventory  model  will  never  order 
more  than  its  non-Bayesian  approximation.  The  proof  will  assume  continuous  ran¬ 
dom  variables.  It  appears  that  the  proof  can  be  modified  in  a  straight-forward 

way  to  hold  for  discrete  random  variables  of  the  exponential  class. 

The  single-crossing  property  we  will  need  is  that  there  is  a  function  m(t^), 

where  t^  is  the  observed  demand  in  period  1,  such  that  for  any  given  t^,  -  00  < 
t  <  the  distribution  functions  of  demand  in  period  2  satisfy  the  following 

<Mtlt1)  <  5,(0  t  <  m(t.) 

1  1  1  1  (13) 

<I>2 (t  1 11)  >  $2(t)  t  >  m(t1). 

We  will  show  at  the  end  of  this  section  that  the  normal  distribution  satis¬ 
fies  (13).  In  [2]  it  is  also  shown  that  (13)  holds  for  the  Poisson  distribution. 


vrm  m  '  gw 


TW1 


We  note  that  the  concept  of  a  single  crossing  property  has  proven  quite 
useful  in  determining  bounds  in  reliability  theory  (Barlow  and  Proschan  [3, 
Theorem  4.2.18]). 

We  now  state  two  results  of  Karlin  [14]  for  the  Bayesian  inventory  model. 
Fact  1.  The  optimal  return  functions  f^(x,S)  defined  by  (5)  are  continuously 
differentiable  and  convex  functions  of  x. 

Fact  2.  The  optimal  policy  is  determined  by  critical  levels  x*(S),  such  that  if 
at  the  beginning  of  period  n  the  inventory  level  is  x,  and  the  current  suffi¬ 
cient  statistic  is  S,  then  the  optimal  policy  is  to  order  Max(x*(S)-x,0) . 

It  is  well-known  that  similar  results  hold  for  the  non-Bayesian  inventory 
model.  The  critical  levels  for  the  non-Bayesian  inventory  model  depend  only  on 

the  period  n,  and  will  be  dentoed  by  x  .  The  following  lemma  gives  expressions 

n 

for  the  derivatives  of  f2  and  f 2  with  respect  to  x  where  is  defined  by  (5) 
and  by  (9).  Note  that  we  allow  the  holding  and  penalty  costs  to  vary  with 
the  period. 

Lemma  1.  f^Cx.t^  =  max{-c,-p2+(p2+h2)^2(x| t^ }  and 
?2(x)  =  max{-c,-p2+(p2+h2)<J>2(x)}. 


Proof .  From  Fact  2  and  the  equation  of  optimality  (5). 


(x,t.)  =  | 

l  L*(x|tl) 


if  x  <  x2(t1) 
if  x  >  x*^) 


(14) 


where  L2(x|t^)  =  -  p2  +  (p2+h2) j  4>2 ( t | t^) dt .  The  critical  level  x*(t^)  is 

0 

precisely  that  value  of  x  such  that  -  c  =  L’(x|t1).  Since  Lj(x|tx)  is  increas¬ 
ing  in  x  the  result  is  established  for  f2(x|t^).  The  same  approach  also  works 
for  f2  which  completes  the  proof. 
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Lemma_2 .  In  period  1,  the  optimal  critical  level  for  the  Bayesian  model 
is  less  than  or  equal  to  that  for  the  non-Bayesian  model,  5^  £  x*,  if  for  any  y, 

Et  max{-c,-p2+(p2+h2)$2(y-T1  ITj^)} 

_>E-  max{-c,-p2+(p2+h2)52(y-T1) }. 

Proof.  The  critical  level  x*  minimizes  G^y)  =  cy  +  L^(y)  +  3ET  f^y-T^T^), 

and  x^minimizes  (^(y)  =  cy  +  L^Cy)  +  (SE^  f2(y-Tp.  Since  G^y)  and  G^Cy)  are 
differentiable  and  convex  in  y,  then  x*  is  that  value  of  y  for  which 

G{(y)  =  c  -  Pl  +  (Pi+hjJ^Cy)  +  ET^f 2 (y-1!  I Tx)  -  o 

and  x^  is  that  value  of  y  such  that 

G|(y)  =  c  -  p1  +  (p1+h1)$1(y)  +  E-  f^(y-Tp  =  °* 

By  Lemma  1  and  the  hypothesis  E^,  f2(y-T^|l^)  j>  E-  f2(y-fp,  so  that  G^(y) 

G|(y)  since  ^(y)  =  ^(y).  Since  Gj  and  Gj  are  increasing  functions,  x*  £  x^ 
which  completes  the  proof. 

Therefore,  our  objective  is  to  show  that  the  hypothesis  of  Lemma  2  is  sat¬ 
isfied.  Our  strategy  will  be  to  show  that  the  random  variable  Y  =  ^(y-TpTp 
is  more  risky  in  the  sense  of  Rothschild  and  Stiglitz  [18]  than  the  random  vari¬ 
able  X  =  $2(y-T^).  The  related  idea  of  one  random  variable  being  more  spread 
than  another  was  introduced  by  Bessler  and  Veinott  [5]  and  applied  to  an  inven¬ 
tory  problem. 

Lemma  3.  (Karlin  [23]).  If  tj  >  t^,  then  4>2 ( - 1 1^)  £  <I>2 ( •  1 1 . 

Lemma  4.  The  function  m  in  (13)  is  non-decreasing. 

Proof.  Let  t^  >  t^,  we  want  to  show  m(tp  m(t^).  Suppose  the  contrary, 
that  m(t^)  <  m(t^).  Then  there  exists  an  x  such  that  m(tp  <  x  £  m(t^).  By 
(13),  $2 (x 1 t^)  £  $2(x)  and  $2(x|t’)  >  $2(x).  Hence  <I>2(x|tp  >  ^(xltp,  but 
by  Lemma  3,  4>2(x|tp  £  $2(x|tp  for  all  x  when  tj  >  t^,  a  contradiction  which 
completes  the  proof. 
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Lemma  5.  For  every  y  there  is  a  qCy),  possibly  infinite,  such  that 


^>2(y_tilti)  1  if  ci  ii  q<y> 


$2(y"tlltl)  >  $2^y_tl)  if  tl  <  q(y) 


(15) 


Comment .  Equation  (15)  differs  from  (13)  in  that  t^  is  fixed  in  (13)  and 
varies  in  (15) . 

Proof.  Let  t*  be  such  that  I —  ^2^y_t*^'  1^  no  suc^  t*  exists 

the  lemma  holds  for  q  =  +  00 .  By  (13),  y  -  t*  £  m(t*).  By  Lemma  4  for  any 
t^  >  t*,  m(t^)  £  m(t*)  and  thus  y  -  t^  <  y  -  t*  £  m(t*)  £  m(t^).  We  invoke  (13)  to 
obtain  $2(y_t^  I  tj_)  1  ^2^y-Cl^’  Therefore,  (15)  holds  where  q(y)  = 
inf {t*:^2(y~t*)  £  ^(y-tj))*  The  infimum  Is  achieved  since  ^(y-t^jt*) 
and  $2(y~c*)  are  continuous  in  t*. 

Lemma  6.  ET  ^(y-^l^)  =  E-  ^(y^)* 

Proof :  Et  $2(y“TllTl)  =  ET  P^T2  —  y-TilTi^*  ®y  t*ie  properties  of  condi¬ 
tional  expectation,  P(T2  £  y-T1 | T^)  =  P(T1+T2  £  y) .  Similarly  E-  ^(y-^)  = 
p(T2  <  y-TL). 

By  the  independence  of  T^  and  T2>  E-  P(T2  £  y-T^)  =  P(T^+T2  £  y) . 

This  concludes  the  proof  using  (8). 

Lemma  7.  Let  y  be  a  given  arbitrary  inventory  level.  For  any  z, 

/'z 

J  $2(y~ti|ti)(,)i(ti)dti  -  *2(y-t1)?1(t1)dt1  ■  d6) 

Proof.  If  z  <  q(y)  then  (16)  follows  from  Lemma  5  and  the  fact  that  =  For 
_  z  -I 

z  >  q(y),  let  A(z)  =J  *2<ywtl<ti)*l(tl)dtl  and  B(z)  =  J  V^l^l^l^l* 

-eo 

00  a 

Then  A(z)  =  J  $2(y-t1  ( tx) 4>1  (t]L)dt;L  -  C  ^2^**1 ltl^l^tl^dti 
~°°  z 

B(z)  = /*”  $2(y-t1)$1(t1)dt1  -r  $2 (y-t1)$1(t1)dt1, 

_  an  •  ^  l 
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and  (16)  follows  from  Lemma  6  and  Lemma  5. 

Lemma  8.  Let  X  =  $  (y-T^ ,  have  distribution  function  F  and  Y  =  ^(y-T-J^) 
have  distrubution  function  G.  Then  for  any  a,  0  £  a  £  1 


>%oo  O 

J  UJdG(a))  >  y 


0)dF  (a)) 


G-1  (a) 


F_1(a) 


where  G-1(a)  is  well-defined  since  by  assumption  the  distribution  function  of 
is  strictly  increasing.  A  similar  statement  holds  for  F  1(0. 

Proof.  We  note  that  Y  and  X  are  strictly  decreasing  in  and  T^,  the  for¬ 
mer  by  Lemma  3.  Therefore,  Y  >  G-1(ct)  if  and  only  if  T  £  S’”1  (ot)  where  $1  is  the 
common  distribution  function  of  T^  and  T^.  In  other  words,  Y  will  be  in  the  top 

a  percentile  exactly  when  T^  is  in  the  lower  a  percentile.  Also  X  £  F  ^(a)  if 

.-1 


and  only  if  T^  £  ^  (a).  Consequently,  using  Lemma  7, 


wdG(w)  -  j  ^2(y-t1|t1)«>1(t1)dt1  > 


G-1(a) 


/•*:*(<*>  - 

y  i$2(y-t1)4i1Ct1)dt1  =  y  udF  (to) 

■°°  F_1(a) 

which  completes  the  proof. 

Definition  (Rothschild  and  Stiglitz  [18]). 

Let  X  and  Y  be  two  random  variables  with  distribution  functions  F  and  G 
respectively.  Then  Y  is  more  risky  than  X  if  and  only  if  for  every  z 

^/*F(x)dx  <  y)dy.  (17> 

_ Co  — 00 

In  [18]  Rothschild  and  Stiglitz  establish  two  other  equivalent  definitions 
of  risk.  We  now  derive  a  general  result  for  comparing  the  riskiness  of  two 
random  variables. 


£ 
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Proposition  1.  Let  X  and  Y  be  two  continuous  random  variables  with 
strictly  increasing  distribution  functions  F  and  G  respectively.  Also  let 
E(X)  =  E(Y)  .  Then  Y  is  more  risky  than  X  if  for  every  a,  0  <  a  <  1. 


/ 


ydG(y) 


*  / 


xdF(x) 


F-1 (a) 


G  (a) 

Proof .  In  order  to  establish  (17)  for  all  z  it  suffices  to  establish  (17) 
for  z  such  that  min(F  ^(0),  G  ^(0))  <  z  _<  max(F  ''"(I),  G  ^(1)).  For  such  z  the 
fact  that  F  and  G  are  continuous  and  strictly  increasing  implies  that  there  is 
an  a  satisfying  either  F  ^(a)  =  z  or  G  ^(a)  =  z. 

Suppose  F  ^(a)  =  z  and  G  ^(a)  >  F  ^(a). 

(JO  QQ 

/  ydG(y)  -  [ l-G(y) ] y  1  +  /'  (l-G(y) )dy,  and 

G-1(cO  J 


•-!,  ,  G  (a) 
G  (a) 


f  xdF(x)  =  -[  (1-F(x)]x  1  +  Z' 

F  (a) 


(1-F(x))dx. 


F  (a) 

Applying  our  hypothesis, 
,-1,-  x  _-l 


F  (a) 


(1 


-a) [G-  (a) -F~  (a)]  +  y  (l-G(y))  dy  -  f  (l-F(x) )dx  > 


g'V) 


F~1(a) 


Since  (l-G(y))  is  decreasing, 

yr*G  (ot)  i  I  _i 

y  (1-G(y))dy  >  [G~A(a)  -  F-1(a)l [1-G(G  A(a))]  =  (G_1(a)  -  F'X(a)]  tl-al. 
F-1 (a) 

Therefore  by  combining  the  last  two  inequalities, 

f  1-G(y))dy  _>  J'  (1-F(x))dx,  and 


f”1 (a) 


F_1(o) 


/*F-1(a)  -F"1 

J  G(y)dy  >  /  F( 


(a) 


F(x)dx  since  E(x)  =  E(Y) , 
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Now  suppose  F  (ct)  —  z  and  F  (a)  >  G  (a) .  Since  Ex  =  Ey  the  hypothesis 

.  .  ,  ,  x»F_1(a)  /'G_1(a) 

is  equivalent  to  the  inequality  f  xdF(x)  >  J  ydG(Vy/ 

—00  — 00 

Applying  intergration  by  parts  we  get 


xF(x) 


-]F-1(a)  F'1(a) 


T  w  -|G-1(a)  G'1(a) 

J  ~  J  F(x)dx  -  yG(y)  +  f  G(y)dy  >  0 

co  —oo  r.  •/ 


•  F_1 (a) 


z'  r 

Since  G  is  increasing,  J  G(y)dy  >  [F"l(a)  _  g"1^)  ]G(G-1(ot)) 

G-1 (a) 

[F  (a)  -  G  (a)]a.  Combining  these  two  inequalities  yields. 


,F_1(a) 


F-1(a) 


S'1-  t  la; 

y  G(y)dy  -  f  F(x)dx  >  0 

Jo 


The  proof  where  G  (a)  =  z  is  similar  and  this  completes  the  proof. 

Proposition  1  holds  where  X  and  Y  are  integer-valued  random  variables.  In 
this  case  when  z  is  not  an  integer,  there  is  no  a  such  that  either  F-1(a)  or 
G  (a)  =  z.  However,  the  above  proof  works  by  establishing  (17)  for  z^  and  z  where 
z_  =  max{F-1(a):  F_1(a)  <  z,  G-1(a):  G-1(a)  <  z)  and 
z  =  min{F-1(a):  F-1(a)  >  z,.G-1(a):  G-1(a)  >  z}. 

Then  we  use  the  fact  that  F  and  G  are  constant  on  (z^.z)  to  obtain  (17)  for 
z.  If  X  and  Y  have  strictly  positive  probabilities  on  the  integers  then  z_  and 
z  will  be  the  two  integers  surrounding  z.  , 

Theorem  1.  In  period  1  the  optimal  critical  level  for  the  Bayesian  model 
is  less  than  or  equal  to  that  of  the  non-Bayesian  model. 

Proof .  By  Lemma  8  and  Proposition  1  the  random  variable  *s 

riskier  in  the  sense  of  Stiglitz  and  Rothschild  [18]  than  *n  [18] 

they  show  that  if  U  is  a  convex  function  and  Y  is  riskier  than  X  then  E(U(Y)) 
E(U(X)).  This  is  precisely  what  we  need  to  satisfy  the  hypothesis  in  Lemma  2 
letting  U(x)  =  max(-c,-p2+(p2+h2)x) . 

We  conclude  this  section  by  giving  some  results  which  show  that  (8)  and  the 
single-crossing  property  are  satisfied  by  the  normal  distribution.  In  [2]  it 
is  shown  that  (8)  as  well  as  (13)  hold  for  the  Poisson  distribution.  The  normal 
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distribution  has  the  drawback  as  a  demand  distribution  since  there  is  a  strictly 
positive  probability  of  negative  demand.  If  this  probability  is  sufficiently 
small,  this  should  not  proscribe  its  use.  This  difficulty  is  really  no  more 
serious  than  using  an  unbounded  distribution  such  as  the  Poisson  in  a  situation 
where  an  absolute  bound  can  be  given  for  demand.  In  [A]  Bather  has  used  a  Weiner 
process  to  describe  demand,  and  the  increment  of  a  Weiner  process  over  any  in¬ 
terval  is  normally  distributed. 

Example.  The  Bayesian  demand  T^  in  period  n,  n  =  1,2,  is  a  normal  random 

2 

variable  with  an  unknown  mean  w  and  a  known  variance  o  .  The  conjugate  prior  on 

2 

w  is  also  normal  with  mean  y^  and  variance  o^.  DeGroot  [7]  gives  the  distribu¬ 
tion  of  T^  and  C^lT^t^)  and  Azoury  [2]  shows  that  T^  +  T2  is  normal  with  a  mean 

2  2 

of  2Pq  and  a  variance  of  Ao^  +  2o  .  Therefore,  (8)  is  satisfied  with  T^,  T2)t^, 
T^,  and  7  as  given  in  the  table  below. 


Period  1 

Period  2 

Bayesian 

t1~n(Mo,<£k>2) 

(T2  |tl)~N  (rlp0+r2tl,Cf2+O0rl) 

Non-Bayes ian 

V'K^w!) 

T2~N(y0*3°0+°2) 

where  r^  =  o^/  (a^+a^  J  and  =(°g/  °q+°  )• 

The  single  crossing  property  of  the  normal  distribution  is  established  by 
the  next  two  results. 

Lemma  9.  If  F  and  G  are  distribution  functions  of  two  normal  random  vari- 
ables  with  means  and  y^,  and  variances  op  and  a G  respectively  I  with  cyfOg  )  » 
then  there  exists  an  x^  e(-°°,«»)  such  that 
F(x)  G(x)  if  x  £  Xq  and 
F(x)  >  G(x)  if  x  >  xQ 
2  2 

if  and  only  if  a  <  o_. 

f  G 

Proof .  Let  Z  represent  the  standard  normal  variable. 
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FCx)  =  P(Z  <  (x-yiF)/oF)  and  G(x)  =  P(Z  <  (x-pG)/oG)  . 

Now  F(x)  <  G(x)  if  and  only  if  (x-pF)/0F  <  (x-Pq)/°g  or  x  <  (OgUp-OjdJg)/ (°g_0f) • 

Hence  F(x)  >  G(x)  if  and  only  if  x  >  (0„p  -0_y_)  /  (o  -0.,) .  Therefore 

Ur  r  b  b  r 

X0  =  (0GyF“0FVG)/CV°F)*  (18) 


Proposition  2.  For  any  given  t^,  there  exists  an  m(tF)  eC-00,00)  such  that 
<5>2(x|ti)  _<  $2(x)  when  x  £  m(.t^),  and  <I>2  (x  1 1^)  >  $2(x)  when  x  >  m(tF)  . 

Proof.  This  is  a  direct  consequence  of  Lemma  9  since  the  variance  of 

i  2  2  2  9  9  -  2  2 

(T2 1 1^)  is  0  +  0Qo  '/(Oq+o")  and  variance  of  T2  is  3a~  +  u  and  clearly 

O2  +  0202/(02+02)  <  02  +  302.  From  (18)  we  see 


mCtj^) 


(riVr2ti)v^^o  ~  poN/q2+0oa2/Coo+°2) 

/t2+302  J T2+0202/  (Oq+O2  ) 


(19) 


Note  that  m(t^)  in  (19)  is  increasing  in  t^  as  promised  by  Lemma  4. 

The  Non-Depletive  Inventory  Model 

Mathematically,  the  non-depletive  inventory  model  differs  from  the  standard 
inventory  model  in  that  demands  cause  shortages  but  do  not  decrease  the  inventory 
level.  A  consequence  of  this  hypothesis  is  that  the  inventory  level  is  non¬ 
decreasing  over  time.  The  problem  which  motivated  this  analysis  is  the  inventory 
control  of  recoverable  or  repairable  items  (Sherbrooke  [21],  Miller  [15], 

Miller  and  Modarres-Yazdi  [16]).  Recoverable  spare  items  are  purchased  to  offset 
a  random  number  of  items  that  will  be  in  repair.  At  each  time  point  during  the 
period  if  the  random  number  of  items  in  repair  (demand)  is  greater  than  the  number 
of  spares  (inventory  level)  a  shortage  results.  Next  period  the  spares  are  avail¬ 
able  to  meet  demand  and  the  decision  is  whether  to  purchase  more  spares. 

This  model  is  also  applicable  to  capacity  expansion  with  linear  costs 
(Arrow,  Beckman,  and  Karlin  (pp.  92-105  in  [4]),  since  demands  result  in  short¬ 
ages  but  do  not  deplete  the  capacity  (inventory). 
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Rather  than  being  restricted  to  a  comparison  between  the  Bayesian  and  non- 
Bayesian  models  we  introduce  the  computationally  valuable  idea  of  a  partially 
Bayesian  model  of  order  M  or  model  B^  where  1  £  M  _<  N.  A  partially  Bayesian 
model  of  order  M  updates  the  distribution  of  demand  up  to  period  M  using  demand 
information  of  the  previous  M-l  periods. 

Therefore,  B^  is  the  non-Bayesian  model  (Case  I)  and  BN  is  the  Bayesian 

model.  The  following  exhibits  the  sequence  of  demand  distribution  functions 

for  the  models  Bw  and  BW1,. 

M  M+i 


Periods: 

1 

2 

M 

M+l 

•  •  • 

model  Bw 

M 

*1 

*2 

$M 

$ 

M 

<i> 

*•*  M 

mode!  Bm+1 

*1 

*2 

•"  % 

$ 

M+l 

<b 

•'*  M+l 

Its  computational  usefulness  comes  from  the  fact  that  a  partially  Bayesian 
model  is  easier  to  solve  than  a  Bayesian  model  (especially  when  the  practical 
range  of  the  sufficient  statistic  is  expanding) ,  yet  be  nearly  as  accurate  in 
cases  where  the  estimate  of  demand  parameters  stabilizes  quickly,  and  when  most 
of  the  ordering  takes  place  in  the  early  periods. 

Our  objective  is  to  show  that  when  <  M2  the  amount  ordered  with  model 
B^  is  never  more  than  with  B^  for  the  first  periods.  The  proof  will  be 
given  for  continuous  random  variables  in  the  exponential  class.  In  [2]  the  proof 
is  given  for  the  non-par ametric  Bayesian  case  with  Dirichlet  prior.  The  proof 
uses  some  results  of  Ferguson  [9,10]  in  non-parametric  Bayesian  statistics. 

Let  fM(x,S)  denote  the  expected  value  of  discounted  costs  from  period  n  to  the 
n 

the  end  of  the  horizon  for  a  partially  Bayesian  model  of  order  M,  where  the  in¬ 
ventory  level  before  ordering  is  x,  the  sufficient  statistic  is  S,  and  an  opti¬ 
mal  ordering  policy  is  followed. 

The  optimality  equation  for  the  model  BM  varies  depending  on  whether  the 
sufficient  statistic  is  updated  or  not.  For  periods  n  -  1,...,  M-l, 
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f 


where 


w 

f^(x,S)  =  min  /cMy-x)  +  L^(y|s)  +  3  /*fM  (y,S»t)4>n(t  |s)dt.  (20) 
y>x  *  q  n+i 

y.OO 
* 

P(t-y)<t>n(t  |s)dt,  and  S°t  =  S  +  (t-S)/n. 


Since  inventory  is  non-decreasing  any  holding  cost  can  be  included  in  the 

N 

the  ordering  cost  by  c  =  c  +  6  ^~n^h. 

i=n 

For  n  =  M, . . . ,N 

f>,S)  =  min  |cn(y-x)  +  L^(y|s)  +  Cy ,s)|  (21) 

y>x  ' 


where 


<(yls)  “^X'pCt-yJ^CtlsJdt,  and  f*1  =  0. 


The  main  difference  between  (20)  and  (5)  is  that  in  (20)  the  starting  inven¬ 
tory  in  period  n  -f  1  is  y  rather  than  y  -  t.  The  same  applies  to  (21)  when  com¬ 
pared  to  (9). 

We  begin  with  a  result  analogous  to  Lemma  1. 

T  aimng  1(1  cl  _ _  1  ~  ^  „  n  ) 


Lemma  10.  ^  f”(x,S)  =  max  {“c.^  J^Cx.S)  | 

where 

00 

J^(x,S)  =  L^(x|s)  +  3  f  ^(x.SoO^^Isjdt 


if  n  <  M  and  for  n  >  M 
jJJ(x,S)  =  L^(x|s)  +  3fJJ+1(x,S). 

Proof.  From  Fact  2  given  before  Lemma  1  and  the  equations  of  optimality 

(20)  and  (21)  there  exists  x*M(S)  such  that 

n 


£  #-ls> 


/  *M 

i  -c  if  x  <  x*  (S) 
—  n 


u 

£  j^(x,s)  if  x  >  X;M(S) 
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The  critical  level  x*  (S)  is  precisely  that  value  of  x  such  that 

n 

-c  =  JM(x,S).  It  remains  to  show  that  ^  J^‘(x,S)  is  increasing  in  x.  Now 


~  dx  n 
for  n  <  M-l, 


-  -  P+P» 


n(x|s)  +  B j 


0°^fn+l(x’SOt)4>n(t|S)dt-  (22) 


The  convexity  of  f^+1(Fact  1)  implies  that  f^+1(x, Sot)  is  increasing  in 
x  which  completes  the  proof  for  n  £  M-l  and  the  proof  for  n  >_  M  is  the  same 
after  modifying  ^  J^(x,S). 

Lemma  11.  Lei;  T  be  the  demand  in  period  n.  For,  1  _<  n  _<  M, 

Vn+l(xlS°T))  =  VXIS)* 

Proof.  This  follows  as  a  basic  consequence  of  conditional  expectation. 
Chung  [6,  Theorem  9.1.5.]. 

Lemma  12.  Let  T  denote  the  demand  in  period  M.  Then  for  k  =  M  +  1,...,N 

E  rp  f^*"1(x, SoT)  >  fJVx.S). 

T  dx  k  —  dx  k 

Proof.  We  begin  the  induction  for  k  =  N.  By  Lemma  10,  equation  (22),  and 
the  fact  that  =  0, 


K  -IZ  =  Et  max [ -c , -p+p$  ..  (x | S  °T)  ] 


JT  dx  N 


Since  U(x)  =  max{-c,-p+px)  is  a  convex  function,  by  Jensen's  inequality 


ET  cix  fN+1(x>SoT^  -  ,^{-Cf-P^ET$Mfl(xlSoT))} 


max{-c,-p+p$M(x|s)}  by  Lemma  11, 

d  ,M. 
dx  fN(x,S)< 


Therefore,  the  result  holds  for  k  =  N.  Now  assume  it  holds  for  some  k, 
M  +  1  <  k  N,  and  we  show  that  it  holds  for  k  -  1.  By  Lemma  10  and  (22) 


h  ^  Cl(x’S#T)  =  et  max{-c,-p4p$M+1(x|SoT)  +  0  ^  fJ^x.SoT)  }. 


d  ,M+1 , 
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By  Jensen's  inequality 


ET  0X’S°T)  -  max{-c,p+pET<JM+1(x|s0T)  +  BEt  ±  f”+1(x,S<>T)}  > 
max{-c,p+p<*>M(x|s)  +  6  f^(x,S)}  =  — ■  f^Cx.S). 

The  second  inequality  uses  Lemma  11  and  the  induction  hypothesis  Q.E.D. 
Lemma  13.  For  k  =  1,2,..., M,  ^  f*+1(x,S)  >  ^  f*(x,S). 

Proof .  For  k  =  M  and  by  Lemma  10, 


_d  rM+l 
dx  M 


Now  we  assume  the 
it  holds  for  k-1. 


(x,S)  =  max{-c,-P4p*M(x|s)  +  3Et  ~  f^J(x,SoT)} 

2  max{-c,-p+p$M(x|s)  +  3  ^  f^+1(x,S)} 
d  M 

=  ^  fM(x,S),  the  inequality  by  Lemma  12. 
result  holds  for  some  k,  where  2  £  k  _<  M,  and  show  that 


fk-l(x’S)  =  max{-c ,  -P+P^>k_1  (x  |s)  +  BEt  ^  f^x.S-T)  } 

and  ^  fk-l(x’S)  =  lnax{"C|"P+P^k_1  (x  |s)  +  BEt  ^  f^(s,SoT)} 
By  the  induction  hypothesis  we  have 

d  -M+l ,  .  d  _M , 

<jx  (x.Sot)  fj^(x,Sot)  for  every  t  so  that 

ET  ^  fk+1(x»SoT>  -  ET  ^  f”(x,S»T)  and  hence 
d  ,M+1 .  ,  d  ,M 

<jx  til_^vX,S)  fk-l^X’S^’  which  completes  the  proof. 


The  following  theorem  compares  the  critical  levels  for  models  B  ,  and  B 

M+l  M 

during  the  first  M  periods. 

Theorem  2.  The  critical  levels  satisfy  x*M+1(S)  _<  x*M(S)  for  £  =  1,2,...,M. 

Proof.  For  £  +  M,  x*Mfl(S)  satisfies 

,  d  M+l .  . 

d^  JM  (x’S)  =  0  or 

c  -  P  +  PVXIS)  +  PEt  ^  fMtl(x’SoT)  "  °»  (23) 
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(24) 


dx  J£  (x,S)  -  dx  J£(x,S) 

*M+1  +M 

which  implies  that  x£  (S)  _<  x*  (S) ,  and  this  completes  the  proof. 

For  1  <  M2  <,  N,  we  can  now  derive  a  comparison  between  the  critical 

ordering  levels  for  models  B„  and  Bw  during  the  first  K,  periods. 

Mi  m2  \ 

Corollary  1.  For  >  M2>  xj^S)  <  x*M2(S)  for  £  =  1,2,...,^.  Beyond 
period  they  are  not  comparable. 

Proof.  Apply  Theorem  2  ^-M^  times. 

Corollary  2.  In  period  1,  the  optimal  critical  level  for  the  Bayesian  model 
is  less  than  or  equal  to  that  of  the  non-Bayesian  model. 
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